Using a balanced scorecard to identify opportunities to improve code review effectiveness: an industrial experience report

Peer code review is a widely adopted software engineering practice to ensure quality and reliability in both the commercial open-source projects. Due large effort overhead associated with practicing reviews, project managers often wonder, if their reviews are effective there improvement opportunities that respect. Since at Samsung Research Bangladesh (SRBD) were also intrigued by these questions, this research developed, deployed, evaluated production-ready solution using Balanced SCorecard (BSC) strategy SRBD can use day-to-day management monitor individual developer’s, particular project’s or entire organization’s effectiveness. Following four-step framework of BSC strategy, we– 1) defined operation goals research, 2) set metrics measure effectiveness 3) developed an automated mechanism those metrics, 4) monitoring application inform key stakeholders. Our model identify useful achieves 7.88% 14.39% terms accuracy minority class F1 score respectively over models proposed prior studies. It outperforms human evaluators from SRBD, replaces, margin 25.32% 23.84% score. In our post-deployment survey, developers indicated they found as it provided them important insights help decision makings.